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ABSTRACT 

The classical shift retrieval problem considers two signals in 
vector form that are related by a cyclic shift. In this paper, 
we develop a compressive variant where the measurement of 
the signals is undersampled. While the standard procedure to 
shift retrieval is to maximize the real part of their dot prod- 
uct, we show that the shift can be exactly recovered from the 
corresponding compressed measurements if the sensing ma- 
trix satisfies certain conditions. A special case is the partial 
Fourier matrix. In this setting we show that the true shift can 
be found by as low as two measurements. We further show 
that the shift can often be recovered when the measurements 
are perturbed by noise. 

Index Terms — Compressed sensing, shift retrieval, sig- 
nal reconstruction, signal registration. 

1. INTRODUCTION 

Compressive sensing has received growing interest in signal 
processing. The theory mainly concerns recovery of a high- 
dimensional signal from its downsampled measurement when 
the source signal is sufficiently sparse fl~l|2]. In this paper, we 
show how the basic premise of compressive sensing can be 
used in the context of shift retrieval. In particular, we con- 
sider two signals of the same dimension that are related by 
a shift transform, and we are interested to know under what 
conditions such a transform can be exactly recovered from 
measurement of each of the signals in a compressed low- 
dimensional space. We refer to this approach as compressive 
shift retrieval (CSR). 

Concretely, let y and x be vectors of length n and let D 
denote a cyclic-shift by £. Assume that y and x are related by 

y = D l x. (l) 
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We assume throughout the paper that the shift is unique (up 
to a multiple of n). Let Abe am x n sensing matrix where 
m < n, and define the compressed measurement signals z = 
Ay and v = Ax. Our goal is to determine the shift I from z 
and v. 

In shift retrieval and other more general signal alignment 
problems, a standard procedure is to seek the shift that maxi- 
mizes the real part of the inner product: 

maji$i{(x,D s y)} = maji$i{x*D s y}. (2) 

s s 

In this paper we consider the related test: 

max$l{(z,D s v)} = max$l{z*D s v}, (3) 

s s 

with £> s = AD S A* . We show that when the sensing ma- 
trix A is taken to be a partial Fourier matrix, then under 
suitable conditions the true shift can be recovered from both 
noise free and noisy measurements using Furthermore, 
([3]l reduces both the computational load and the number of 
samples needed. This is of particular interest since recent 
developments in sampling (3j |4] [3J have shown that Fourier 
coefficients can efficiently be obtained from space (or time) 
measurements by the use of an appropriate filter and by sub- 
sampling the output. Remarkably, our results also show that 
in some cases sampling one Fourier coefficient given by Ax 
and Ay, respectively, is enough to perfectly recover the true 
shift. 

2. COMPRESSIVE SHIFT RETRIEVAL 

Assume that z and v are given and that these are related to x 
and y via the sensing matrix A. Our goal is to find the shift 
relating x and y. To this end, we propose to use the test Oj. 
As we will see in the following, this simple test has several 
desirable properties and can be guaranteed to recover the true 
shift under certain conditions. 

We first prove the following main theorem of CSR assum- 
ing the measurement is not affected by noise: 

Theorem 1 (Shift Recovery from Low Rate Data). Let X 

be an n x n matrix with the ith column equal to D % x, i = 
1, . . . , n, and define D = AD* A*. If the sensing matrix A 
satisfies the following conditions: 



1) A* AD S = D S A* A, 

2) 3a £ K, aAA* = I and 

3) all columns of AX are different, 



then 



max 



(4) 



recovers the true shift. 

The conditions of Theorem[T]may seem restrictive. How- 
ever, as we will show in the following, if A is chosen as a 
partial Fourier matrix, then the two first conditions of Theo- 
rem[T]are trivially satisfied. The last condition is the only one 
that needs to be checked and will lead to a condition on the 
Fourier coefficients sampled. 

Before proving the theorem, we state two lemmas. 

Lemma 1 (Recovery of Shift using Projections). Let X be 

the n x n-matrix made up of cyclically shifted versions of x 
as columns. If the columns of AX are distinct, then the true 
shift can be recovered by 



mm 

qe{0,l}" 



Ay-AXqg s.t. \\q\\ = l. 



(5) 



Proof of Lemma^ Since the shift relating x and y is as- 
sumed unique, it is clear that the true shift is recovered by 



mm 

q e{o,i}" 



y-Xq\\l s.t. ||q||o = l. 



(6) 



Assume that the solution of <|3j is not equivalent to that of 
Namely, assume that (|6]l gives q, <|3j gives q and q ^ q. 
Since q will give a zero objective value in Q, so must q. We 
therefore have that Ay = AXq = AXq and hence 



AXq - AXq = AX(q - q) = 0. 



(7) 



Since q, q £ {0,1}", ||q|| = ||q|| = 1, and q + q, 
AX(q — q) = implies that two columns of AX are iden- 
tical. This is a contradiction and we therefore conclude that 
both <j5j and |6j recover the true shift. □ 

Lemma 2 (From |5} to Q). Under conditions 1) and 2) of 
Theorem^ the shifts recovered by {5) and Q are the same. 

Proof of Lemma^ Consider the objective of Q: 

|| Ay - AXqg =(Ay)*Ay + (AXq)* AXq 

-(Ay)* AXq -(AXq)* Ay. (8) 

Writing Xq = D s x, problem |5]l is equal to 

ma^2^i{(Ay)*AD s x} - (AD s x)*AD s x. (9) 

S 

Now, if A* AD S = D s A* A and using that (D S )*D S = I 
for a shift matrix, then 



which is independent of s. Therefore, the shift recovered by 
|9| is the same as that of 



maji$i{(Ay)*AD s x}. 



(11) 



Lastly, if we again use that A* AD S = D s A* A and 
aAA* = I, then Q follows from 

^{(Ay)*AD s x} = ^R{y*A*AD s x} (12) 

= a${y*A*AA*AD s x} (13) 

= a^{y* A* AD S A* Ax} (14) 

= a$i{(z,D s v)} (15) 

where z = Ay and v = Ax. □ 
We are now ready to prove Theorem [T] 

Proof of Theorem^ The assumptions of Theorem [T] imply 
that requirements of both Lemmas [T] and [2] are satisfied. The 
theorem therefore follows trivially. □ 

The conditions of Theorem [T] can be checked prior to ac- 
tually computing the estimate of the shift. However, knowing 
the estimate of the shift, it is easy to see from the proof of 
Lemma[T]that it is enough to check if the column of AX as- 
sociated with the nonzero element of q is different than all 
other columns of AX. We hence do not need to check if all 
columns of AX are different. 

Of particular interest is the case where A is made up of a 
partial Fourier basis. That is, A takes the form 



A = 



_2yKkl 

1 e n e 

2j*k 2 

1 e » 



1 e 



2(n-l)jxfc 2 



where k\, . . . , k m 6 {0, 1, 2, ... n 
specific choice, 



1}, m < n. For this 



AX = 



Xk 1 



Xk-, e~ 



Xk 2 e 



2(n-l)fc 1 ^j 



Xue 



2(n-l)fc m n-j 



where X r denotes the rth Fourier coefficient of the Fourier 
transform of x. Using this result in Theorem 1 gives the fol- 
lowing corollary: 

Corollary 1 (Shift Recovery from Low Rate Fourier Data). 
With A denoting a partial Fourier matrix and Z{ and Vi the 
ith element of z and v, 



max 3? < ZiVi 



(16) 



recovers the true shift if there exists a p £ {1, . . . , m} such 



(AD s x)*AD s x = x*(D s )*A*AD s x = \\Ax\\^ (10) that x ^ ^Q and {!,..., n- 1}£ contains no integers. 



Remarkably the corollary states that all we need is two 
scalar measurements, z and v, to perfectly recover the true 
shift. The scalar measurements can be any nonzero Fourier 
coefficient of x and y as long as all elements in {1, . . . , n — 
l}^ 1 contains no integers. Also note that only 2mn multipli- 
cations are required to evaluate the test. 

We need the following lemma to prove Corollary [T] 

Lemma 3. Let A be a partial Fourier matrix. Then D s A* A = 
A* AD S for all s = 0, 1, . . . ,n - 1. 

Proof of Lemma^ Let M = AD S and Q = A(D S )*. By 
the definition of D s , M is a column permutation of A where 
the columns are shifted s to the right. Thus, the rth column of 
M is equal to the fth column of A where t = (r — s)mod n. 
It is also easy to see that (D s )* permutes the columns of A 
by s to the left so that the rth column of Q is equal to the qth 
column of A where q — (r + s)mod n. Now, the prth element 
of A*M = A* AD S is given by 

1 rn 

(A p )*M : , r = (/L„f4,, , -V^^l 

i=i 

(17) 

where A : p is used to denote the pth column of A and M . , r 
the rth column or M. On the other hand, the prth element of 
Q*A = D S A* A is given by 

1 m 

(Q, p )*A r = (A p+s )*A r = Te^« +J - r ). (18) 



»=i 



Clearly, the two are equivalent. 



We are now ready to prove Corollary [T] 

Proof of Corollary^ Lemma [3] gives that Condition 1) of 
Theorem[T]is satisfied. Since a full Fourier matrix is orthonor- 
mal, a matrix made up of a selection of rows of a Fourier ma- 
trix satisfies Condition 2). The last condition of Theorem [T] 
requires columns of AX to be distinct. A sufficient condition 
is that there exists a row with all distinct elements. As shown 

2j7Tfc p (r-l) 

previously, the prth element of AX is X^ e » .If Xk 
is assumed nonzero, a sufficient condition for AX to have 
distinct columns is hence that e « e >» , r\ , r<z £ 
{0, . . . , n — 1}, ri 7^ r 2 . This condition can be simplified to 
— + 7, 7 e 1 By realizing that r\ — r 2 takes 

values in {— n + 1, . . . , —1, 1, . . . , n — 1} we get that the 
condition is equivalent to requiring that there is no integers 

k 

in {— n + 1, . . . , —1, 1, .... n — 1} — . Due to symmetry, a 
sufficient condition for distinct columns is that there exists a 
p e {1, . . . ,m} such that X kp ^ and {1, . . . , n - l}^f 
contains no integers. Last, if we write out AD S A* we get 

jn and hence 

□ 



that the prth element is equal to <5 P)J -e 
the simplified test proposed in (T6| . 



Example 1 (A Monte Carlo Simulation). In this example we 
carry out a Monte Carlo simulation. In each trial we let m 



and t be random integers between 1 and 9 and generate x by 
sampling from a n-dimensional uniform distribution. We let 
n = 10 and make sure that A in each trial is a partial Fourier 
basis satisfying the assumptions of Corollary^ We carry out 
10000 trials. The true shift was recovered in each run by the 
simplified test of Corollary [7] This is quite remarkable 
since when m = 1, we recover the true shift using only two 
scalar measurement z and v and 1/5 of the multiplications 
that maximizing the inner product between the unprojected 
signals ([2} would have needed. 

3. NOISY COMPRESSIVE SHIFT RETRIEVAL 

Now we consider the noisy version of CSR, where the mea- 
surements z and v are perturbed by noise: 



z = z + e z , v = v 



(19) 



Similar to the noise free case, here we can also guarantee the 
recovery of the true shift. Our main result is given in the 
following theorem: 

Theorem 2 (Noisy Recovery). Let x be such that v = Ax, 
let the ith column of X be shifted versions of x, assume that 
A is a partial Fourier matrix and that the noisy measurements 
are used in ( |16| l to estimate the shift. If the l2-norm difference 
between any two columns of AX is greater than 



2+ e„ 2 



1*11! + Pll! - 2 max K{ (5, 



□ then tlie estimate of the shift is not affected by the noise. 



Proof of Theorem^ From Lemma[2]we can see that seeking 
s that maximizes 3?{ (z, D s v) } is equivalent to seeking q that 
solves 



mm 
ge{o,i}- 



AXq 



s.t. 



|g||o = i, 



(20) 



where the first column of AX equals v (which defines the 
first column of X) and the ith column of X a circular shift of 
the first column i — 1 steps. Assume that q solves ( |20) . Since 
our measurements are noisy, we can not expect a zero loss. 
The loss can be shown given by 

||i - AXq\\j = \\v\\ 2 2 + \\z\\l - max25R{i*£) s i;}. (21) 

s 

Now, consider \\z — AXqW^. Assume that q Q solves the noise 
free version of ( |20| ) and let X = X + H. We have the 
following inequality 

\\z - AXq\\ 2 = \\z + e z - z + AXq - AXq\\ 2 
= \\e z + AXq - AXq\\ 2 
= \\e z + A(X-H)q -AXq\\ 2 



> \\AXq Q -AXq\\ 2 



e, a 



ev 2 



where we used the fact that AHq Q = e v . Therefore 

\\AXq Q -AXq\\ 2 < A zv . (22) 

Since ||g|| = |<7ollo = 1> we g et that if the ^2 difference 
between any two columns of AX is greater than A vz , then 
q = q. □ 

Example 2 (Recovery of Shift from Noisy Data). In this 
experiment we run a Monte Carlo simulation consisting of 
10000 trials for each m = 1, . . . , 10, and for two different 
SNR. In Figure^ 10 histograms are shown (corresponding 
to m = 1, . . . , 10) for 



SNR 



z-z 



(23) 



being 2 (low SNR) and in Figure^ 10 (high SNR). e z and e x 
were both generate by sampling from 



Af(0,a 2 )+jAf(Q,a 2 



(24) 



We further used n = 10, £ = 5 and sampled x from a uni- 
form (O,l)-distribution. The conclusion from the simulations 
is that the smaller the m, the more noise sensitive estimate 
of the shift. 12 % of the correctly estimated shifts could us- 
ing Theorem^be predicted to be the same as the noise free 
estimate for m — 1 and the high SNR case while 40 % for 
m = 2. 
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Fig. 1. Histogram plots for the estimated shift and low SNR. 
From left to right, top to bottom, m = 1, . . . , 10. The true 
shift was set to 5 in all trials. 



1 
1 



Fig. 2. Histogram plots for the estimated shift and high SNR. 
From left to right, top to bottom, m = 1, . . . , 10. The true 
shift was set to 5 in all trials. 

Theorem [2] gives conditions for when the noise does not 
affect the estimate of the shift. This is a good property but 
even better would be if the recovery of the true shift could be 
guaranteed. This is given by the following corollary. 



Corollary 2 (Recovery of the True Shift from Noisy Data). If 
the £ 2 difference between any two columns of AX is greater 
than 2||e„||2 and the conditions of Theorem^are fulfilled, 
then ( |16| l recovers the true shift. 

Proof of Corollary^ Let q and q be any vectors such that 
llQllo = IIqIIo = 1, Q + qandq,q G {0,1}". Using the 
triangle inequality we have that 

\\AXq - AXq\\ 2 = \\A(X +H)(q- q)\\ 2 (25) 
<\\AX(q-q)\\ 2 + \\AH(q-q)\\ 2 (26) 
<\\AX(q-q)\\ 2 + 2\\e v \\ 2 . (27) 

Hence, if \\AXq - AXq\\ 2 - 2\\e v \\ 2 > then \\AX(q - 
q)\\ 2 is greater than zero. Now since Theorem [5] gives that 
(jT6j recovers the same shift as if the measurements would 
have been noise-free, and since Corollary [T] gives that the 
noise-free estimate is equal to the true shift if || AX(q — q)\\ 2 
is greater than zero, we can guarantee the recovery of the true 
shift also in the noisy case. □ 

4. RELATION TO PRIOR WORK 

Optimizing a shift retrieval function such as |2| can appear in 
a broad category of signal alignment problems, which have 
a wide range of applications in signal processing and image 
processing. In signal processing, shift retrieval has been used 
to align acoustic signals for segmentation or averaging ||6] |7) . 
In image processing, studies related to image registration and 
target tracking typically are more focused on recovering more 
general 2D image transforms, including 2D shifts, scaling, 
and affine transform, that aligns a target image to a reference 
image JS1 [9] [10). In addition to the objective function |2]i 
widely used in the literature, another popular dynamic pro- 
gram for signal alignment is known as dynamic time warp- 
ing m. 

In the compressive sensing framework, compressive sig- 
nal alignment problems have been addressed in only a few 
publications. In |[T2l . the authors considered alignment of 
images under random projection. The work was based on the 
Johnson-Lindenstrauss property of random projection, and 
proposed an objective function that can be solved efficiently 
using difference of two convex programming algorithms. In 
this paper, we instead focus on proving theoretical guarantees 
of exact shift recovery when the signal is subsampled by a 
partial Fourier basis. 

A more recent work called RASL addresses alignment of 
an ensemble of correlated signals |10|. The premise of the 
RASL method is that the ensemble of the signals in vector 
form can be concatenated in a low-rank matrix if the mis- 
alignment between them can be compensated. However, the 
method has not provided an analysis of the performance in a 
downsampled feature space, and does not deal with the pair- 
wise alignment problem, e.g., the shift retrieval problem Q. 
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